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ABSTBACT ' 

In three experiments sub jects (college an£ high 
school students) read passages which described psychological 
principles and an/svered either adjunct application or factual 
questions ifhtle reading. Questions were presented either tcfore, 
afters or both beforehand after the ^arts cf the passage that > 
answered tKe questions* Subsequently sub:jects tcck a pcsttest 
cont aininq* new factual and appllcaticu iteml^ The important result 
was subjects given factual preguestions or factual pre* or 

post^questions did better than subjects given adjunct .application 
questions. This result conflicted with previcus findings and 
theorizing and raised guestions about boundary conditions within 
which previous qeneralizatidns apply. (Authcr/RD) 
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Adjuirct Application questions pi&cllitat^ Later Application, Or Do: THey?r, JsK^*}: j 
'Thomas Andre, Kenneth Smld, Gary Groth, Martin Runge 
Iowa State University ' 

Abstract , - 

l^n thtee experiments subjects (college and high school students) ^ead passages 
which described psychological principle^ and answered 6lther adjunct application 
or factual questions while reading. Questions were preseinted ieither before, 
after, or both before and after the parts>of the passage that answered the 
questions. Subsequently subjects took a po8|:test containing new factual and 
appli'c^tion items. The importsftit result was that subjects given factual pre- 



questions (Exp. 1> or factual pre- 01^ .^ost-questions (Expl 3) did better than 
subjects ^iven adjunct applic4tion questions. This result cd^'flictQji with 
previous findings and theorizing and raised questions About, boundary conditions 



within which previous generalizations apply. 
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Adji^ct Application Quesjions FaelUtate Later Application,,' Or Do They? 

. Research on the effect&pf qife$,tions on 1 earning; from prdse has yielded 
two generalizations tliat stfOTi to Jj),e* widely accepted. ; The first is ,that it 
;is better to place que^stioh;? a^ftelr relevant text ^thaft J)efore'it. Placing ^ 
/questloils prior to relevant- t^tf powers recall of iniformation of' material 



not. directly related to the -cfuestlons. JPlacing* questions after the rele- 
vant text enhances recall not directly related t^^tjj>e^ques^^^ While ' 
this generalization has begja questioned (Ca;rver, 1972; Ladas, 1973); a^ recent 
review of this literature shows that' thfe data from'most studies su^orts the 



generalization (Anderson and Biddle, 19^5). 

The second generalization is that asl^in^ students to 4pply presented 
qfbncepts and* principles while reaSing eiihances theiijr ability to*^ later apply 
^ those concepts and principles in new situfitions. (Watts krid Ande^fson, 1971; 
Felker and Dapra, 1975). Students asked applicatio^^q^estio^^^ duVng learn- 
ing do better on new application questions than students 'asked 'factual dues- 
tions during learning. The enhancement is limited td th# particular concepts 
and principle^ about which students were questioned (Moore, ^1,975) : 

The symdard interpretation of both the question position aiidjqu^stion^ 
level effect^ is thut these varii^bles pro^^ce their effects by influencing ' , 
the manner i^ subjects read ahd think about the text^ It is believed 

Kthat qu^js^on' position directly influences the aspects o/ the material to 
which subjects Attend. When the questions c^hQQ before the passage, subjects' 
selectively attend tJjjjjbnly that informatioii .in the tej^lPwhich answers the 1 " 



questions, when questions come after the text, the subjects carefully read 
all the text because they cannot be ^jyre which itemis of information will be 
required. The question level effect occurs because the question influences 
the kind of semantic processing in which sub^ect^ engage. - With an ipplick- 
tion question the subject is led to process thos€^. ias^ects of the jp^resented 



inforaation that peitiit later lipplication, of the information and thereby 
forms a representation of the ihfornation in memory that facilitates later 
application. ^ 

. ^ - - J 

Given the manner in which position an4 level are assumed to influence 
subjects' processing, it seems reasonable to suppose that ^the two variables 
would interact. When subjects are given a low level questiontwpri&r to v ' 
rea^ng a segment of text it is possible for them to limit their attention 
to relevant portions of ^hat segment. However if sulfjects are givdht^ a * 
higher level question^ prior to reading a-t^kt, it would not be possible far 
them to IJmit their attention to selected portions of the text since, answer- 
ing the higher level question entails comprehending the passkge. i;f the 

., **' * ■<•»-.' 

question is an application question for exanple, there is np specific, item 

of information to which attention may be limited, the subj ect . must "read and 

understand the whole passage. Thus higher level questions presented prior 

to the passage should nqt be deterimental to but should facilitate .lefiming 

from the passage. 

This interpretation is supported by a stjj^(dy bf Rickards (1976) in which 
students were given either higher- l,evel or low- level questions befpre^o'r 
after reading segments of a passage and were^as^CdHo recall the passage. 
Higher order questions presented prio^ to ^the passage enhanced recall o^^the 
passage. However, the Rickards study use4 higher ordet questions tha^de- 
.mahded relatively simple iliferences fron/tlk s^ujiifilts andf also used a measure 
of learning that involved/rote recall of the passage. ; Thus it yielded little 
inform/titm about how question lever and position might, influence th^^qui^i 
tion of higher-order l^^ming from a passage. ^ - f ' ' 

FelkeriEffid ^pra (1975) compared comprejtensioir oiL.^^^ pre- 
smted before or after relevant' passages. Conprehension post questions, but 
not conprehensioit pre-questi^s, facilitated later probrem-solving involving 
the presented concepts and principles. This finding is somewhat counter—- 



^ 0 



intuitiv^;. t;he c^dnpri^hension pre-qtiestions should give the subject a set 
to i|nd^8tand^ the- material ju^t as stron|[ly as dpes the comprehension ptfst- 
qdestion* The preset e4>ciriment w^s designed to further examine the 
effects of question position and iquestibn level learning to apply pre-', 
sented concepts and principle|. V 



Method . ^ _ 

Subj el?ts ; The siibjects were 1^0 undergrad|uttes talcing psychology courses 
at iowa State University ^ Both male and female students were included in 
the sample but records of gender were not k^t. Subjects received extra 
course credit for their participation. V " . ^ 

Design : Jha^esign can be considered a 2X3 between-subject factorial, k 
Either name Questions or applicati^ questions were ^inserted in a pros^e 
passage. oType of. question represented the fi^st factor in the 4esign. 7n^ 
" questions were placed either^ before, aft^r, or both before and after the 
pages! whose content provided answers to ;the qufsjtions. Position of q^jkstion 

- . ^ . ■ ' ^. i ' \^\. ' 

provided the second factor in the Resign. After reading the. passage sumects 
took an 80 i^^ posttest on the cpntent of the passage. There were sevem 
different types of questions repr^ented on this posttest, Sub^ectsyplsa 
coopleted the Wide Range Vocabulaiy Test (French, .Ekstrom, and Pridi&, 1963). 
N The data- for each of the seven types of posttest questions were analyzed 
using a 2 1 3 analysis of co-variance with vocabulary test score afs the 
CO- varying nieasure. f 

Materials : The materials for thij study consisted^ of a ten page passa; 
which defined and gavi|» exanpies/ of 10 psychological concepts or principles, 
ia set of adjunct questions which were inserted in the passage « and a posttest 
on the content of* the passage; <^Each page in the passage described a different 

/ ~ ' " , ° / ■ 

psychological concept. Each page was written in thfe sa«e format: the first 

"■• ' ^ ' I ' ^ . ■ ■ ■■■■■ r 



parag^ph the page presented an example of the concept, thj^econd 
paragraph gie a verbal deffnition of the concept, presented/ the name of^ V 
psychologist associated with the concept, and pve soma incidytal infor- ' 
, v nation about the concept. The thitd paragraph gave a second eLa^le of ' 
the concept. ' 

. Seven multiple-Choice questions were written for each text page.. 
Naa^ question asked the student to select the' name of the psycholog^t 
associated with the.concept from a list of five altemativelOthe distrac- 
tors wete the names of other psychologists used in the passage! Distr^actor 
names were randomly chose? with th^ Restriction that each usfed equally" 
often over the ^et of 10 Na^e questi6ns. Three Application «,uestions were 
^ .written fox each page. Two of these Application questions asked students < 
to select\an example of the concept from a set of four alterJatiJes. The 
. . exanples used as correct alternatives were different^ from the examples 

presented on the page. The distractors-for these application^,^ questions 
, .were made^^i^ to sound plausibly related to the concept or principle. The 
distractor contained the elements used in the concept but arranged, these 
elements differently. Sometimes only some of the nece^sar^'lWiiti wfre 
used in writing a distractor.' Since the itan stem prescntedAe" name of the 
concept and, the altlmatives possible examples of Vhe cpncepV^tTiese two 
- Application Questions were called Application-Term-^VExample quest^ps. 
The third appli^tion questioji presented^he s^ntswith :aiv ixanjple of thee 
'concept '01^ principle and asked .students to select the n^me of the^conceF«t ot 
principle ftom a set of four alternatives. *The distractors'^i^ed x«S^h/ - 
na^es of the other concepts and principles -preselhted in the ^^. ^^^^^ 
^re randomly selected with the restriction that they be used^^u^Uy often as 
^-Tpbssible over the set of 10 questions. TTiis type^of q^i^tii^k was lab^jed an 
X/Apptication-Example-tp-Terin question. >.Pactual question as\ed the stji^fent to 



reij^ognije e^gajplicuiyr fact presented in t^^.^^^^^^^' questions 

made up by t|(kinV|a sentence or ph^as^ passage whlch^^esented 

incid«Kt^^l in format ion\ about the coAc«pt jn'^ ""^^^"^ * ""l^iple^choice . 

question out of the sentence or phras^. tJi*^*^ question^ We^e prett^ much 

■ • u ■ \ " " * * ' ■■ 

^ ^ verbatim in, the sense . deWribed' by Ancl^efso" ^^^^ ' i--!^' 

,J^) written which sounded plaiisible. /A R^p^t*^, *l"®^?^ioh AK^JsOi-" 

dfAts to recognize one of t^he two «xampxi^ ^"v^#^^"^t as an ' I 

examjile of presented cojJkepV- The fo^^oAt e^l^J^^^^^'if^^^^^^^ 
was the same as Applieation-term-to-ExafltoK .'^ist^actors were 

prepared in'^the ?am<j"»wa>^; A Definition qu^f'*^''^ jp®** f ^^ents to recog- 



nize "th^ correct ^de^Ht*<>n^o^y he cqnce|»t ^l ^-^v^ P*^*^ted in the text. 
All Definition questions were four ch^ik^ fi^r^^^ que/tions^; dis- 

tractors again were written to s^und pikuji*'^^' / ^ stem and 

Vcorrect ailtiern&tiviB substantially \enpioy4 *''®' ^.a"8»ia]^e us^ in the passage, 
so the- questions 'were verbatim level^qu^§t*f"* i^Anaerson, ^^ p y gj ^ Tlt efte.^^^ 
materials were ^^ased gi^ materials deVei^^ ^derson (1971). 

Five Of the descriptions- of concepts, t^eiJ" questions, ^^eir Repeated 
.Exai()le questions, and^some of their c^ftoci^^^V^P^^^^*^ 

questions had been writ|^en by W^tts and^An^i^^^^' ^^ining deslbriptions 

* * 2 * 

and questions were written specificaHy^o^ ^^^^ study^ The new materials 

^ conformed to the format and style used tif^^^^ Anderson.^ * ^ 

The Name que^ion an^ one of the Afpli^*^^^^'^®™"^^"^^*n?l® questions 
were chosen to\be used as adjunct questi^^ in^^ted in t^e^p^^gsages. The 
particular APPlication-Term-to-Exani^le aW^^^^^^^ adjunct questions 



were determined rai|R)mly. TKe material^ w^^^ P^«P«e<l in 4itto^d bipoklets, " 
The text pages tof the b9oTclet4^ere t^^^i^^ ^^Vlite type, each 

text page described one concept and tOoK at^*^^ \ ^^^gle-spaced ipage 

(250-300 wotds). The Applicatioij^iterin^^.^3^"P^^ ''"^ questions used as 
adjunct questions were reproc^^ one p^^ j)^*^ separate sheets. The 



materials were assembled into booklets appropriate for the various condi- 
tions of the experiment. . 

A cover page on the booklet provided general directions for the experi- 
ment and specific directions for each condition. The; general directions 
told students to read the m&terial; that th^urpose of the study was to 
investigate how people learned from written materials; to read the text for 
a subsequent test; and to answer the insert^ questions they encountered 
as they read . / 

■ ■ ■ / 

In the Questions Before conditions^ the booklets consisted of) alter- 
nating miestion and text pages. The ^propriate application or name ques- 
tion WAS inserted in the booklet before the text page. The cover page 
instructed students to answer the inserted question without turning ahead 
^to the text even if the students had to guess. In the Questions After 
conditions, the booklets consisted of alternating text and questions pages. 
The cover page indicatc^d that students were to read the text page/ then 
turn to the question and answer it witl^out turning back to the text page. 
Again studcmts were told to answer the adjunct questions even if they had 
to guess. ^ In the Questions Before and Ajfter conditions the booklets con- 
sisted of 10 sets of question-text-question pages. The appropriate adjunct 
question was presented before the related text page and repeated after the 
text page. Instructions on the cover page told students to read the before 
question but not answer it, to read the text without ttoming back to the 
before question or ahead to the after question, and to answer the after 
question without turning back to the text page. The ox^er of concepts within 
the booklet was randomized but was the same in all conditions. 

A seventy-item posttest consisting of the seven items made up for each 
of the 10 concepts was prepared. The order of items on the posttest was 
randomized. TKe Name and^j^plication-Term-to-Exaiqple questions used as 

ERIC / - ^ - . \ 



adjunct questions were repeated in this posttest. Students answered this 
posttest onfjichine-scorable answer sheets. 

Procedijre: The subjects were rup in large* groups in- a college cLsroom. 
As each subject entered the experimental room he was handed a booklet, for 
one of the experimental conditions. The booklets contained the Wide Range 
Vocabulary. Test, the instructional passage and adjunct questions. The 
booklets were taken serially from a stack ^ which booklets for the various 
conditions had been unsystematically arranged. In this way students were 
randomly assigned *o conditions. Subjects were given 10 minutes to complete 
the Wide Range Vocabulary Test. At the end of 10 minutes, subjects were 
; told to read the directions on the cover of their booklet and begin working 
on the passage and adjunct questions. Subjects read through the booklet 
and answered quesUons at their own pace. Proctors in the room enstffed 
that students did not turn ahead or btck to text pages while ansWing the 
adjunct questions. When a subject completed the booklet, he raised his 
hand «pd a proctor brought- him jhe 70 item posttest. and remove^the passage 
booklet. When the subject completed this posttest. he again raised his 
hand. A proctor came, collected the booklet, thanked the subject and dis- 
misse<l him. 

Results 

The data were analyzed separately for each of the seven ^ypes of post- 
test scores described above. The analysis and results for each of the post- 
test types is discussed separately. Table 1 presents the means for each 
condition for each type of score. / 

' Na5eJfcyi»|ion£: The analysis of covarianCe reveal^ a significant effect 

of type o^ questions. F (1.113) - 9.62. p< .003; students who rectff^red Name 

Questions as adjunct question? did better on those same Name Questions when * 

they wereirepeated on the posttest (Name Adjunct Questions = 4.35. Application 

* t 



Adjunct Questi^s ■ 3.36). There was also a tendency for subjects .who 
received questions after the relevant text pages to recall names bett* 
than subjects who received questions either before or both before and after 
the text pages, F (2,H3) " 2.67, p<.072; After - 4.32, Before = 3.80, 
Before and After * 3.40. 

Repeated Application-^Torm-to-Example Questions ; Neither Type of 
Question nor Position of Question produced significant variation in the 
data (both Fs le^s than one). Table 1 presents the individual cell means. 

New Application-Term-to-Exanple Questions: Only. the interaction of 
Type of Question and Position of Question proved significant, F (2,113) = 
4.31, p<.015. Table 2 presents the cell means. Basically this interaction 
occurred because the effect of Type of Question changed as a function of 
Position of Question. When questions came after the relevant pages. Applica- 
tion Questions led to superior performance, yAien questions came before the 
relevant pages Name Questions led to siqperior performance. When questions . 

came both before and after the text page. Name and Application questions 

• <^ 

led to equivalent^ performance. However, when tested by simple main effects 
tests the difference was significant only for the Before Question condition, 
F (1,39) = 9.4249, £<.01. 

Application-Example- to-Term Questions : Neither Position nor Type of 
Question produced reliable variation in the data. Table 2 presents ^e' 
means. In all groups performance on these questions tended to be relatively^ * 
high. - 

Factual and Definition Questibns: For neither of these variables were 
Position and Type of Question significantly related to performance. Table 1 
presents the mean cell values. 
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Discussion ( * 
The results of the present study were quite surprising. The hypothesis 
that higher order questions would facilitate performance on a later applica* 
tion test regardless of queitioi/position was not supported. Instead the 
(^effect of Type of Adjunct Question was moderated by position of the question/ 
When the questions came after the relevant text application questions tended • 
to facilitate perforjaance on a later test of new applications. Thus perform- 
ance on the riew Application-Term-to-Exampre questions was good in both the 
After and Before-»and-After Application Question Groups. This result weakly ^ 
replicates the finding, by Watts and Anderson (1971). Performance in the 
before ^conditions is wliat is puzzling. When questions came before the rele- 
vant text, name questions led to superior performance. Thus performance was 
high in the Before and Before and Af^r Name question .groups. This latter 
result conflicts with the results of Felker and Daprf (1975). In their 
study both before factual and before comprehension questions failed. to 

i ^ ■ 

facilitate performance. 

One possible explanation of the present results may be based on inter- 
ference notions. Sttidents in the before application condition read a com- 
plex questioli containing four alternatives* written to sound related to the 
concept or principle^ Without having knowledge of the presented concept or 
principle, they would have -no means of differeAtiating the real example of 
the concept from the distractors. These subjects would have to read and 
reaember the ^our possible examples in order to relate them to the subsequently 
presented text. Interference between the wron^exanples presented in the 
distractora and the information presented on the text page could account for 
the poor performance of the Before Application question group on the posttest. 
The problem with this argonent is that it does not explain tlfc superior 
^performance of the Before Name question conditions. While it is true that 
subjects in these latter conditions would not have had a confusing set of 



; • . Xl 

exftMples to deal with and thus would not suffer interference, it is not 
clear why subjects given Name Questions before the text would do better' 
than subjects given Naae questions aher the text. The differential p.^, 
. forMnce of the groups given name questions before or after the text that 
is. the most puzzling result of the present study. A theoretical model 
that would handle this finding is not readily apparent. v 

A second puzzling finding is that students given application questions 
while reading do not do any better on those questions when they were repeated 
on the posttest. This finding conflicts witH Watts and Anderson (197i) ^d 
also 'to other studies which show that students do well on repeated questions 
y . (Anderson and Biddle, 1975). 

The nature of the procedures used in the present study may be related 
to the differences in the present findings. Subjects read 10 passages and 
then took a long poittest. Thte avefage time to 6omplete the experiment „as 
approximately 1.5 hours and some students took up to hours. It was 
clear that many students were bored and answering questions perfunCtorUy' 
at the end of the inten^al. While it is not clear what effect this low ^ 
motivation would have, it is possible that the differences in results between 
J studies may be due to differences in motivation between the groups. Accord- 
ingly Experiments 2 and 3 were done in an attempt to eliminate problems with 
the length of the materials. ' 

Experiment 2 

With some minor changes in procedure, Experiment 2 was a replication of 
Experiment 1. Two variables i^ere again manipulated. Type of Adjunct Question 
and Position of Adjunct Question. The basic purpose of ExperiiBent^2 was to 
determine if the results, of Experiment 1 would replicate in a study that used" 
shorter passages than Experiment 1. 

Method 

( Subjects; The subj ects were 155 male and female students taking undergraduate 
psychology courses at Iowa State University. ,The students received course 
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credit far their participation^ 

Materials: The bppklets used in Experiment 1 were divided into two parts. 

s 

^Ont part coiitained the first five text.pag^s and assbciated questions and the. 
isecond part contained remaining text pages and questions?. Cpver sheets 
appropriate for the condition were added to the second part booklets. Thus . 
the materials used in Experiment 2 were identical to those used in Experiment 
1 except that subjects read about only S concepts instead of 10., The booklets 
CQntaining the first 5 text pages and questions were labeled Form 1; the book- 
lets containing the second 5 text pages^nd questions were labeled Form 2. 
Separate posttests, containing the seven types of questions used in 
"Experiment 1 but limiting those questions to those concepts discussed in a ' 
particular form, were prepared. The Form 1 posttest contained the questions 
appropriate for the Form 1 booklet; the Form 2 posttest was appropriate for 
the Form 2 booklet.. The questions used in Experiment 2 were identical to the 
questions used in Experiment 1. The order of posttest questions within forms 
in Ei^eriment 2 was randomly determined. 

In addition to the 35 multiple choice questions, the posttest contained 
10 short answer questions. These short answer questions contained 5 applica- 
tion questions in which students were given an exanple of a concept or principl 
and asked to ^ply the concept name, and 5 repeated example questions in which 
students were given an examj^le of a concept that had been used in the text and 
were asked to write the concept name. The examples used in the short answer 
repeated exaiqple questions Were different from those used in th/multiple 
choice repeated example questions. 

design is essentially similar to Experiment 1. There were 2 sub- 
stantive factors, Type of Adjunct Question (Name or Application) and Position 
of Adjunct 9uestion (Before, After, or Both Before and After the relevant text 
page). In addition since «ie booklet and posttest forms were not equated for 
difficulty Test Form W4s includ^ as a blocking factor to eliminate variance 
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associated with form. The design can be represented as a 2 (Form) x 3 
(Position) X 2 (Question-O^ype) factorial with all factors between subjects. 
Procedure ; The procedure for Experiment 2 was essentially like Experiment 1. 
As subjects preceded through th^ir booklets they recorded the elapsed time 
./by writing a number written on the front board of the room on a time record 
sheet as they completfed each booklet page. One of the proctors incremented 
the number every 10 seconds. 

Results and Discussion 
"'^"" in Experiment 1 separate analyses of variance were conducted for 
each of the seven types of posttest questions and for the short answer ques- 
tions. The results can be summarized quickly; across all seven analyses, the 
only sources of variance proving significant were the main effect of form (in 
6 analyses) and twb interactions involving form. , None of these interactions 
were interesting. Table 2 presents the means. These results suggest that . 
neither Type of Adjunct Question or Position 6f Adjunct Question strongly 
influence the nature of learning from prose material which purport to teach 
psychological concepts and principles. 

Experiment 3 

Experiment 3 was alSo a replication of Experiment 1 and Experiment 2^ 
The major differences were that high school student were used as subjects 
and that the materials were reduced to 3 concepts per passage. 

Method 

Subjects : The subjects were 87 male and female students attending Ames High 
School in Ames. Iowa? The students varied from sophomores to seniors and 
included both high and average ability students. The subjects participated 
during their normal class periods. ' 
Materials: Since the study had to be conpleted in the normal SO minutes 
cUss period at Ames High, the material were shortened to 3 concepts per 
booklet. ^This was done by removing the last two CQQcept text pa^s and 
associated questions from the Form 1 and 2 booklets used in Experiment 2. 



Since subjects received only 3 concepts.^'^t did -not seem appropriate 
to include all seven types of items on the ^bsttest. Doing so would have 
led to there being only three questions for each item type and we felt 
that such a three item test would be so unreliable as to produce results 
that would be difficult to interpret. Since it is performance on New 
Application Questions that is of greatest educational interest, we prepared 
a posttest that contained 9 new Application Term to Example questions (3 
for each presented concept) and also^ included the 3 Factual and 3 Defini- 
tion questions used in Experiments 1 and 2. In addition the relevant short 
answer questions used in Experiment 2 were included. We used the latter 
questions simply to get some data on single factual learning of the passages 
Design : The design of Experiment 3 was identical to that of Experiment 2. 
Procedure : The subjects were run in their normal classrooms. When subjects 
entered the room, the classroom teacher explained the purpose of the visit 
arid introduced the experiment. The experimenter then described the study 
in general terms, then with the help of proctors passed out the experimental 
booklets. Booklets were distributed in an unsystematic order. From this 
point forward the procedure wa^ identical to Experiment 2. 

Results 

There were 5 dependent measures analyzed: Short Answer Application 
Questions, Short Answer Repeated Exanqple Questions, Multiple Choice Applica- 
tion Term-To-Exain)le Questions, Multiple Choice Factual Questions, Multiple 
Choice Definition Questions. Separate 2 (Form) X 3 (Position) X' 2 (Question 
Type) ANOVAs were performed for each measure. Table 3 t)resents the results 
for each neasur«. The analyses are discussed separately for each dependent 
measure below. 

Short Answer Application questions t The only significant source of 
variance was Question Position, P(2,60) * 3.823, £<. OS, Questions After 
• 2.21i Question Before ■ 1.97, Questions Before and After « 1.S9. 

15 . 



15 

Short Answer Repeated Example Questions ; None of the sources of 
variance proved significant. 

^plication-Term-' to-Exanple Questions ; Only question Type signifi- 
cantly influenced the data; subjects who received name questibi^s performed 
reliably better ^han subjects who received application questions £ (2,75) 
■ 5.004, p<.05; Name Questions * 4.67, Application Questions = 3^.77^ 

Factual Questions : No sources of variance proved significant. 
Definition Questions : No Sources of variance proved significant. 

General Discussion Experimg||^-3 ^ 
The results of Experiments 1-3 are consiswft neither with previous 
results nor among themselves. Previous results had suggested that giving 
students higher level questions while reading increases the students ability ♦ 
to use the information in the passages they are reading. For example Watts 
and Anderson (1971) had found that ^^students given application questions while 
studying were later more likely to be able to apply the presented concepts 
when given new exaii5)les. Similarly Felker and Dapra (1975) had found that 
students given comprehension questions while reading were later more able 
to solve problems by using the presented concepts and principles. The results 
of the present studies raise serious questions about the generality of those 
findings. 

In the present three experiments subjects were presented with either low 
level factual questions or higher level application questions while reading 
a passage* Considering only new application questions, in the first experiment 
only the subjects getting factual questions before the relevant text performed signi- 
ficantly better than the subjects in the other groups. In Experiment 2 no' 
significant differences in the subjects ability to apply the presented con- 
cepts were found. In Experiment 3 subjects given^ either name or application 
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questions before the relevant portions of the^passage wero-botter able to 
apply the presented concepts. 

• ■■ ,,■ : • . '> 

These results are difficult to understand and interpret. The effect 
of type of question had been interpreted as a level of processing effect. 
It was beyevM that su^ects given a lyigher level question processed the 
presented'inforBation/to a deeper semantic level than subjects given a low 
level question. A ^deeper level of processing leads to a representation 
in memory that permits application of the concept. The present results 
raise questions 4bolit this int^fpretatioit and suggest that the relationship 
^^etween- questi-dn level and depth of processing may be moderated by other 



variables. 



One possible such variable is question difficulty. It makes sense that 
an adjunct qi^stion will not^haye a beneficial effect on processing and later 
application unless the subject is able to carry out the processing necessary 
to answer the adjunct question. If the subject is unable to carry out the 
necessary processing, it^is unlikely thfit a higher order question will 
facilitate performance. Highet-order questions are often more difficult 
than lower order factual questions, this proved true in the Watts and Ander- 
son (1971) study and the present experiments. (Felker and Dapra do not 
report performance on the adjunct questions.) Unfortunately, performance 
on the adjunct application questions appeared ^o be worse in the present . 
studies than in the Watts and .Anderson study. In the present Experiment 
performance on those questions rangp^r^ SAH in Experiment 2 to 43% in Experi- 
ment 3 (the data were not available in Experiment 1). In Watts and Anderson 
performance on the adjunct application questions was about 70%. It may be 
that there is a floor above which performance must rise if adjunct applica- 
tion questions are to have a facilitative effect. In Watts and Anderson, 
performance may have been above the floor; in the present experiments it may 
have l^een below the floor. \ . 
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One mechanism that might produce such a floor^is the effect of the 
adjunct questions on studwir =an~xie#. When sul^jects find the adjunct quel- 
tions difficult, their anxiety lev?l maybe raised to. a high level. It is 
known that liigh levels. of anxietjr usually* reduce performance on complex 
tasks (Anderson and Faust. 1973). Since the new application questions on^ 
the posttest represent fairly coii^lex tasks the performance of subjects on 
these items may have been reduced by the anxiety aroused, by the difficult 
adjunct questions. If subjects find the adjunct questions challenging, but 
not overly difficult, as in the Watts-and Anderson study, a moderate level 
of anxiety may have been aroused. vModerate levels ^T^nxiety facilitate 
performance on complex task?. Obviously this explanation is speculative. 
' but it does suggest tfjat the relationships of anxiety to types of adjunct 
questions should be investigated in future research. 

A second possible explanation for th<i divergent results "iiTthe Watts 
and Anderson and the present results might have beea based upon the time 
subjects took to read the passages. If the typical reading time varied 
substantially between the studies, then the differences could be attributed 
to that variable. Unfortunately while there were differences in reading ^ 
rate between Watts and Anderson and the present Studies, these differences 
were not consistent across e;q)eriments 2 and 3. In Watts and Anderson (| 
reading time averaged about 2.1 minutes per passag^; in Experiment 2 the mea 
was about 1.8 minutes per passage, while in ExperiLnt 3 it was about 5.0 
minutes per passage. 

Watts and Anderson (1971) had failed to find any significant differences 
in average reading ti^ per passage. There were differences in the prfesenjty 
study.. In Experiment 2 there was a tendency for subjects given adjunct 
application questions to take longer to read the passages. Name Questions / 
1.7S min.; Application Questions » 1.93 min.. F(1.144) = 2.900. £< .09. Tl^s 
tendency was confirmed in Experiment 3. F(1.75) - 7.866, p<.01. Name 
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Questions « 5.3 min. ; Applicatidn;Question ^ 6.7. min* Position of Question 

■• • ' • " ^ • * ■ / ' ' ' ■ ' ' 

also hid an effect on reading .$lme in Experiment 3,;F(2,75/ » 3.214, p< .05, 

' ^ . / . ■ • • f ■ ■ • > ■ 

Questions Before « 5.15 min/. Questions After ?s'6.75 min. , Questions Before 
aitd>After « 6.10 min. TOese results arie consistent with the anxiety^iiiterpre- 



^, tation^offered above./ If the subjecjts in the presejit study found the applica- 

y . /. ' ./ - * , / ^ ■ ^ 

tion queistions more difficult and thus were more anxious (relative to the 
subjects wAq w4r^' given Name Questions^) than Wi^tts and Anderson's subjects, 
it makes, so^e that the present application question subjects would spend 
more time completing the task, than had Watts and Anderson's subjects. 

A final i)OssibHity is more speculative, but is still consistent with* 
available data. Watts and Anderson's data were collected in 1970; the spre sent 
data in 1976. Data from a variet]^ of sources such as the Educational Testing 
Serviyce and National Assessment of Edu^a.tional Proicnress have indicated a 
decline in reining abilities over the la^t several years. It may be thiat 

' / ' ^ \ „ ' ■ . ' . \ ' 

t^xs decline in^reading ability has influenced the present results. Differ- 
,^nces in reading ability can be at least partially understood as due. to 
differences in the strategies subjects use comprehending material they read. 
It may be that the strategies that subjects habitually use while reading 
have changed in such a way as to change the ^way in which questions influencef^ 
their performance. One way to assess this possibility would be to Obtain 
extensive descriptions of the readin^g abilities of a group of students and\ 



then use these students as subjects in a study of question level effects 

The major i]q>ort of the present results is tha^ they suggest that the 
effects of question level are more complex than had previously been supposed 
Previous theoretical models are not adequate to accoHmt for the present re- 
su|^s. Both new models anct^more research will be necessary to produce such 
an adequate account. ^ 
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Table 1 



Mean' Recall of Each Iteu Type for Each Condition in Experiient 1 



Condition: 








Type of Pbsttest Question 






Question Type 
and Position 


' Name 


Factual 


Definition 


Term-to-Example 


Example-to-Term 


Repe'ated 
Example 


Repeated 
Applicatic 


Application-QA 


3.8 


. 5.3 


6.7 


6.1 


7 1 

\ 


8.4 


S.4 


ADDlication-OB 








5.6 


7.1 




il A 


Application-QBA 


2.9 


5.7 


6.0 


6.3 


6.7 " , 


7.4 


4.8 


Name-QA 


4.9 


5.9 


6.1 


5.8 


7.2 


8.1 


4.8 


Nane-QB 


• 4.3 

t 


6.7 


6.7 


J.l 


f.8 


■ 8.9 


5.2 


Name-QBA 


3.9 


5.9 


6.1 . 


6.1 


7.4 


7.9 


4.9 



QA=question after, QB=que$tions before, QBA=questions before and after 
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Table 2 



Condition: 



and Position 
Application-QA 
Application-QB 
Application-QBA 



Mean Recall of Each Iten Type for each Condition in Experiment 2 
Type of Posttest Question, 



tTp°!iI(!! Name Faci;ual Definition New Applicition New Application Repeated Repeated 

♦ ' \ Term-to-EAiple Example-to-Ten Example Application 



6.3 
6.5 
5.4 
6.4 
5.0 
6.0 



3.0 


3.0 


3. ,3 


3.0 


3.0 


2.9 


3.1 


3.1 


2.7 


2.6 


3.2 


3.1 


2.9 


3.1 


3.0 


3.4 


3.4 . 


2.4 


2.7 


^2.9 










3.4 


2.9 


3.0 


3,1 



4.1 


4.3 


2.7 


3.9 


4.0 


2.i 


3.8 


4.1 


2.6 


3.7 


4.2 


2.4 


3.4 

« 


4.2 


' 2.6 * 


3.4|^ 


^4.0 


2.3 



QAsquestions affo, QB=questions before, QBA=questions before and after 




Table 3 



Mean Recal] of Each Item Type for Each Condition in Experiment 3 



Condition: 

Question Type 
and Position 



Type of Posttest' Question 



Short Answer Short Answer Factual Definition / New Appl^^*^®^ 
Application Repeated Example 



New i^vv'-'.^ 
Xerm-tO'ExaBple 



Application-QA 


2.3 


1.7 ■ ■ ^ 


■ ',1.9 


1.8 


3.5 


Application-QB 


1.9 


1.5 


M.8 


1.8 


4.2 


Application-QBA 


1.3. 


1.3 


2.0 


1.6 


3.^ 


Name-QA 


2.1 


1.7 


1.8 


1.7 


4.9 


Nane-QB 


2.0 


2.0 


1.5 


1.6 


4.7 


Naoe-QBA 


1.9 


1.8 


1.8 


1.4 


4.3 


QA= questions after, QB=questions before, 


QBA=questions before and after 







